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VALIDATION  OF  TWO  AIRCREW  PSYCHOMOTOR  TESTS 


I.  INTRODUCTION 

This  report  presenis  initial  findings  on  the 
utility  of  two  psychomotor  tests  for  improved 
selection  of  Air  Force  pilots.  During  World  War  II, 
and  for  several  years  thereafter,  an  extensive 
program  of  psychomotor  research  was  conducted 
by  the  Army  Air  Forces  Psychological  Research 
Unit  No.  2  and  the  School  of  Aviation  Medicine 
(now  the  School  of  Aerospace  Medicine).  Selected 
psychomotor  tests  developed  under  this  program 
were  an  intergral  part  of  the  World  War  II  aircrew 
classification  batteries.  This  early  effort  has  been 
gUpribed  by  Melton  (1947).  Generally,  it  was 
found  that  psychomotor  assessments  had  validity 
for  predicting  elimination  from  pilot  training 
beyond  that  obtained  from  paper-and-pencil  tests. 
Use  of  psychomotor  assessments  in  the  Air  Force 
pilot  selection  program  was  discontinued  in  the 
early  1950s  because  of  the  expense  and  difficulty 
of  maintaining  and  calibrating  the  required  equip¬ 
ment  under  decentralized  testing  conditions. 

With  recent  technological  advances,  there  has 
been  a  revival  of  interest  in  the  utility  of  psycho¬ 
motor  assessments  both  for  selection  of  pilot 
trainees  and  for  a  variety  of  other  personnel 
decisions.  In  one  study  sponsored  by  the  Air 
Force,  Passey  and  McLaurin  (1966)  conducted  an 
extensive  review  of  work  in  the  perceptual- 
psychomotor  area  and  provided  tentative  design 
requirements  for  updated  psychomotor  equipment 
and  tests. 

The  Air  Force  recently  completed  an  extensive 
Mission  Analysis  on  Future  Undergraduate  Pilot 
Training:  1975  through  1990  (1972).  This 
included  consideration  of  selection  devices  and 
procedures  most  likely  to  meet  the  needs  of  the 
force  over  approximately  the  next  twenty  years. 
In  anticipation  of  such  ftiture  needs,  planning  for 
development  of  a  psychomotor  research  capability 
began  in  1969  and  progressed  in  1970  to  the 
establishment  of  a  prototype  psychomotor 
research  facility  at  the  Personnel  Research 
Division,  Air  Force  Human  Resources  Laboratory, 
Lackland  Air  Force  Base,  Texas.  It  was  intended 
from  the  beginning  that  this  facility  take 
advantage  of  technological  advances  using  solid- 
state  components  and  mini-computers  in  place  of 
the  somewhat  unreliable  systems  of  the  World  War 
II  era.  The  resulting  system  is  characterized  by 
ease  of  modification,  simple  programming  to 
accommodate  a  variety  of  experimental  tests,  and 


a  capacity  for  easy  expansion  to  include  additional 
subject  test  stations. 

This  study  reports  validation  of  the  first  tests  to 
be  programmed  on  this  equipment.  These  are 
known  as  two-hand  coordination  and  complex 
coordination.  Two  of  the  psychomotor  tests  which 
demonstrated  good  validity  for  pilot  selection  in 
World  War  II  carried  these  same  names,  but  the 
current  tests  were  modeled  after  them  only  in  the 
sense  that  they  require  somewhat  the  same 
response  capability  of  the  subject.  It  was  deemed 
neither  necessary  nor  desirable  to  reproduce  the 
older  tests  exactly.  The  design  of  the  equipment 
and  the  development  of  the  current  tests  have 
been  described  in  detail  by  Sanders,  Valentine,  and 
McGrevy  (1971). 


II.  VALIDATION  STUDY  I 

Subjects 

As  the  final  phase  of  the  development  of  the 
psychomotor  equipment,  148  Air  Force  officer 
trainees  were  administered  the  Two-Hand 
Coordination  and  Complex  Coordination  tests.  Of 
these  subjects,  121  graduated  from  the  School  of 
Military  Science-Officer  and  entered  under¬ 
graduate  pilot  training  (UPT).  All  had  previously 
taken  the  Air  Force  Officer  Qualifying  Test 
(AFOQT). 

The  Tests 

Two-Hand  coordination  requires  manipulation 
of  joysticks,  one  in  each  hand,  to  control  the 
position  of  an  X-shaped  stimulus  on  a  screen. 
Instructions  to  the  subject  require  that  he 
maintain  the  position  of  the  X  as  close  as  he  can  to 
a  triangular  target,  which  moves  in  a  circular  path 
at  varying  speeds.  At  any  given  moment,  a  devia¬ 
tion  of  the  X  from  the  target  constitutes  an  error 
which  is  measurable  both  in  terms  of  the 
horizontal  and  vertical  displacement.  The  smallest 
measurable  error  is  about  .01  inches.  These  error 
measurements  on  two  axes,  when  integrated 
separately  by  the  mini-computer  over  a  specified 
time  interval,  constitute  the  basic  scores  obtained 
from  this  test.  A  Generated  score,  equal  to  the 
square  root  of  the  sum  of  squares  of  the  two  error 
scores,  is  also  obtained. 

Complex  Coordination  requires  manipulation 
of  a  single  joystick  to  control  the  movement  of  an 
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X-shaped  stimulus,  while  at  the  same  time  using 
both  feet  to  control  a  short  vertical  line  which 
hovers  near  tin  bottom  of  the  screen.  The 
instructions  require  that  both  the  X  and  the  short 
line  be  held  stationary  at  points  or.  the  screen 
identified  by  fixed  intersecting  lines.  Error  scores 
on  the  manipulation  of  die  X  stimulus  are 
integrated  over  time  along  two  axes  separately, 
and  a  Generated  score,  defined  as  in  Two-Hand 
Coordination,  is  also  obtained.  The  score  for 
manipulation  of  the  vertical  line  is  the  integrated 
horizontal  displacement  from  the  fixed  inter¬ 
section  over  time.  In  addition,  there  is  a  Reset 
score  which  expresses  the  frequency  per  time 
interval  tha:  the  subject  allows  the  short  line  to 
leave  the  screen.  When  this  occurs,  the  line  is 
returned  automatically. 

The  Predictors 

For  Two-Hand  Coordination,  the  predictors 
were  the  integrated  horizontal  and  vertical  error 
scores,  known  respectively  as  X  Axis  and  Y  Axis 
scores.  The  Generated  score  was  also  used.  For 
Complex  Coordination,  the  predictors  were  X 
Axis,  Y  Axis,  and  Generated  scons,  and  die 
integrated  error  score  for  the  vertical  line.  This  is 
known  as  the  Z  Axis  sc  .  .  Finally,  the  Reset 
score  was  used  as  a  predictor. 

Raw  subtext  scores  on  the  AFOQT  constituted 
another  set  of  predictors.  This  test  is  currendy 
used  in  several  operational  programs,  including  the 
selectku  of  student  pilots.  A  proper  validation  of 
the  psychomotor  tests  must,  therefore, 
demonstrate  that  they  significantly  improve  this 
existing  selection  system.  Most  AFOQT  subtest 
scores  are  not  routinely  computed,  but  special 
arrangements  were  made  to  obtain  them  as  part  of 
the  final  phase  of  Vje  psychomotor  test  develop¬ 
ment.  Subtests  not  normally  involved  in  pilot 
selection  were  included. 

The  Criteria 

Criterion  data  in  die  form  of  graduation  or 
attrition  status  from  UPT  were  obtained  for  each 
subject  during  December  1971  and  January  1972. 
Table  1  presents  the  criterion  distribution  of  the 
subjects.  The  specific  criteria  used  in  the  study 
were  Graduation  and  Flying  Training  Deficiency 
(FTD)  elimination.  To  permit  numerical  analysis, 
each  criterion  variable  was  coded  1  for  subjects 
falling  in  that  criterion  group  and  zero  for  all 
others. 


Table  1.  Distribution  of  Subjects 
by  Criterion  Category,  Validation 
Study! 


CittfOfy  N 

Flying  Training  Deficiency  Elimination  (FTD)  19 

Self  Initiated  Elimination  (S1E)  9 

Manifestation  of  Apprehension  Elimination  2 

Medical  Elimination  4 

Total  Elimination  34 

Total  Graduation  87 

Total  Subjects  121 


Test  Procedure 

AH  testing  war  done  in  December  1970.  The 
subjects  were  first  administered  Two-Hand 
Coordination,  followed  one  minute  later  by 
Complex  Coordination.  Each  teat  involved  four 
minutes  of  standardized  instructions  and  practice, 
of  which  three  minutes  were  for  practice.  Fol¬ 
lowing  the  practice  period,  a  five  minute  test 
session  was  conducted.  For  each  test,  the  error 
scores  were  integrated  over  five  observation 
periods  of  one  minute  each.  Thus,  five  values  were 
avaiable  on  each  psychomotor  predictor  for  each 
subject 


When  the  data  were  analyzed,  it  became 
apparent  that  a  programming  difficulty  had’ 
invalidated  all  Z  Axis  scores.  Other  scopes  were 
unaffected,  and  the  analysis  was  performed  in 
terms  of  them. 

To  provide  a  better  characterization  of  the 
sample  and  to  facilities  interpretation  of  the 
findings,  the  mean  AFOQT  composite  scores  in 
percentie  form  were  computed.  These  were  found 
to  be  as  follows:  Pilot  80,  Navigator-Technical  70, 
Officer  Quality  70,  Verbal  45,  and  Quantitative 
50.  The  very  high  Not  mean  indicates  a  fairiy 
severe  restriction  in  the  range  of  Pilot  scores.  Asa 
consequence,  AFOQT  Pilot  validities  are  under¬ 
estimates  of  their  values  in  the  unrestricted 
population  to  which  the  test  was  applied. 
Navigator-Technical  and  Officer  Quality  validities 
are  also  underestimated  to  some  degree.  Since 
admission  to  the  School  of  Miiitaiy  Science- 
Officer  against  a  pilot  training  quota  requires  a 
minimum  qualifying  score  on  il  three  AFOQT 


composites,  the  assumptions  underlying  the  usual 
corrections  for  range  restriction  could  not  be  met. 
No  corrections  were  attempted. 

A  series  of  multiple  linear  regression  analyses 
were  performed.  These  are  summarized  in  Table  2. 
For  the  psychomotor  tests,  the  X  Axis,  Y  Axis, 
and  Generated  scores  in  each  of  the  final  two 
minutes  of  the  test  session  were  the  predictors. 
Both  psychomotor  tests  yielded  significant 
multiple  correlations  with  Graduation,  but  not 
with  FTD.  When  predictor  values,  including 
Resets,  from  each  minute  of  the  entire  test  session 


were  used,  a  correlation  of  .52  was  obtained 
between  Complex  Ct'ordination  and  Graduation. 
This  correlation  is  significant  beyond  the  .05  level. 
Over  the  same  time  interval,  no  significant  corre* 
lations  were  obtained  from  Two-Hand 
Coordination.  AFOQT  subtests  alone  did  not 
correlate  significantly  with  either  criterion,  nor  did 
a  set  of  predictors  including  AFOQT  subtests  and 
scores  from  both  psychomotor  tests.  This  result  is 
explained  as  a  function  of  the  large  number  of 
predictors  in  the  regression  system.  The  best  single 
test  for  predicting  UPT  performance  appears  to  be 
Complex  Coordination. 


Tcble  2  Multiple  Correlation  of  Psychomotor  Tests 
and  AFOQT  against  Two  Pilot  Training  Criteria 


Number  *f 


NNIttef  THU 

hNIdtn 

CrbCuallon 

FTD 

Two-Hand  Coordination 

6 

.18 

.20 

Complex  Coordination 

6 

.44* 

.32 

AFOQT 

13 

37 

32 

Two-hand  Coordination  plus 

Complex.  Coordination 

12 

.46* 

.38 

Two-Hand  Coordination  plus 

Complex  Coordination  plus 

AFOQT 

25 

.56 

.47 

•Significant  beyond  .05  kreL 


The  hypothesis  was  formulted  that  die  psycho¬ 
motor  tests  make  no  contribution  to  prediction  of 
UPT  Graduation  in  the  context  of  the  AFOOT. 
The  test  of  the  hypothesis  yielded  an  F  value  of 
1.96  and  rejection  of  the  hypothesis  t\  the  JOS 
level.  The  interpretation  is  that,  had  the 
psychomotor  test  scores  been  incorporated  into 
the  selection  battery,  the  prediction  of  success  in 
UPT  would  have  been  improved.  This  is  the  most 
important  outcome  of  the  study. 


III.  VALIDATION  STUDY  II 

Subjects 

The  subjects  for  the  second  validation  study 
consisted  of  92  Office  ^trainees  elected  for  pilot 
training.  All  were  subsequently  commissioned  at 
the  School  of  Military  Science-Officer  and  were 
assigned  to  various  bases  fot  UPT.  AFOQT  scores 
were  available  for  all  subjects. 


Hie  Test 

Although  the  second  study  was  initiated  before 
the  results  of  the  first  were  known,  it  was  decided 
that  Complex  Coordination  would  be  the  sole 
psychomotor  test  to  be  validated.  This  decision 
r.'u  based  on  the  avaQabiity  of  valid  Z  Axis  scores 
for  the  second  itudy. 

Hie  Predictors 

All  Complex  Coordination  predictors  used  in 
the  first  study  were  used  again  in  the  second. 
AFOQT  scores  were  also  used.  However,  the  only 
readiy  available  AFOQT  scores  were  the  opera¬ 
tional  composites  in  percentile  form.  Hie  lengthy 
and  expensive  retrieval  of  AFOQT  answer  sheets 
to  obtain  subtests  was  not  undertaken. 

Hie  Criteria 

The  criteria  used  in  the  first  study  were  used 
again,  and  one  additional  criterion  was  defined. 
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This  wrs  designated  FTD/SIR  and  consisted  of  all 
subjects  who  were  either  flying  deficiency 
eliminees  or  self  initiated  eliminees  from  pilot 
training.  Subjects  in  either  elimination  category 
were  coded  1  and  all  others  zero  on  this  criterion. 
It  was  suspected  that  some  student  pilots  who 
eliminate  themselves  are  impending  flying 
deficiency  eliminees.  Table  3  presents  the  criterion 
distribution  of  the  subjects. 

Table  3.  Distributkxi  of  Subjects 

by  Criterion  Category,  Validation 


Study  H 

C*M9*ry  N 


Flying  Training  Deficiency  Elimination  (FTD)  17 

Self  Initiated  Elimination  (SIE)  8 

Manifestation  of  Apprehension  Elimination  4 

Medical  Elimination  1 

Total  Elimination  30 

Tout  Graduation  62 

Total  Subjects  92 


Test  Procedure 

Subjects  were  tested  in  March  and  April  1971. 
Following  the  standardized  instruction  and 
practice  period,  Complex  Coordination  was 
administered  five  times  with  twenty  minute 
intertrial  intervals.  For  each  administration,  the 
error  scores  were  integrated  over  60  separate 
observation  periods  of  five  seconds  duration. 
Hence,  60  values  were  available  fo;  each  predictor 
on  each  trial  of  each  subject. 

Resuhts 

As  in  the  first  study,  a  series  of  multiple  linear 
regression  analyses  were  performed.  In  these 
analyses  the  X  Axis  and  Y  Axis  scores  were 
excluded  from  the  predictor  system.  This  decision 
was  based  on  the  finding  that  the  mean  correlation 
of  the  Generated  score  with  each  of  these  aids 
scores  is  .92,  based  on  five  observation  periods  of 
one  minute.  For  purposes  of  the  regression 
analyses,  the  60  observation  periods  were 
combined  to  form  five  observation  periods  of  one 
minute,  and  scores  for  each  of  the  five  minutes 
were  used  separately  as  predictors.  The  results  for 
each  five  minute  trial  are  shown  in  Table  4. 


Table  4.  Multiple  Correlation  of  Complex  Coordination  and  AFOQT 
against  Three  Mot  Training  Criteria 

(N-92) 


rmirtwTtm 

Number  of 
MMnv 

TYM 

Onaultoa 

PTD 

PTD/SIC 

Complex  Coordination 

15 

1 

.43 

30 

.43 

Complex  Coordination 

plus  AFOQT 

20 

1 

30 

36 

31 

Complex  Coordination 

15 

2 

36* 

.43 

35* 

Complex  Coordination 

plus  AFOQT 

20 

2 

.62* 

30 

j61* 

Complex  Coordination 

15 

3 

35* 

.44 

35* 

Complex  Coordination 

phis  AFOQT 

20 

3 

.60* 

34 

31* 

Complex  Coord inatinn 

15 

4 

.47 

.41 

.45 

Complex  Coordination 

plus  AFOQT 

20 

4 

.51 

.47 

31 

Complex  Coordination 

15 

5 

31 

.47 

.49 

Complex  Coordination 

plus  AFOQT 

20 

5 

37 

.53 

35 

‘Significant  beyond  .05  level. 


P 


Significant  multiple  correlations  were  obtained 
on  Trials  2  and  3,  when  the  predictors  were 
Complex  Coordination  alone  or  Complex 
Coordination  plus  AFOQT,  and  when  the  criterion 
was  either  Graduation  or  FTD/SIE.  The  AFOQT 
scores  alone  correlated  31  with  each  criterion. 
These  correlations  are  not  significant.  Since  the 
same  selection  standards  apply  to  these  subjects  as 
to  thuse  in  the  first  study,  it  is  assumed  that  the 
AFOQT  validities  lire  again  underestimated.  In  this 
case  the  underestimate  is  somewhat  less  severe, 
however,  as  indicated  by  a  Pilot  composite  mean 
near  70. 

The  hypothesis  was  formulated  that  Complex 
Coordination  scores  make  no  contribution  to 
prediction  of  graduation  from  UPT  in  the  context 
of  the  AFOQT  composite  scores.  The  test  of  the 
hypothesis  yielded  an  F  value  of  2.00  and 
rejection  of  the  hypothesis  beyond  the  .05  level. 
The  implication  is  that  inclusion  of  Complex 
Coordination  scores  in  the  selection  system  would 
improve  the  selection  of  successful  student  pilots. 


Supplementary  data  on  the  zero  order  validities 
and  mtercorrelations  of  the  variables  in  these 
studies  are  presented  in  Appendix  A. 

IV.  CONCLUSIONS 

Data  from  these  two  studies  strongly  suggest 
the  pitot  selection  utility  of  die  psychomotor 
tests,  especially  Complex  Coordination.  While  it  is 
difficult  to  assess  the  actual  correlation  between 
the  various  predictors  and  the  criteria  because  of 
the  complex  ways  in  which  the  data  are  restricted 
in  range,  it  is  nevertheless  clear  that  the  addition 
of  the  psychomotor  tests  to  the  AFOQT  can 
enhance  the  prediction  of  plot  training  success. 
On  this  basis  it  is  recommended  that  an 
operational  version  of  the  tests  and  their 
equipment  be  developed,  and  that  a  large  scale 
validation  of  this  operational  version  be 
undertaken. 
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APPENDIX  A:  SUPPLEMENTARY  TECHNICAL  DATA 


Tables  A1  and  A2  piesent  correlations  among  X  Axis,  Y  Axis,  and  Generated  scores  for  each  minute 
of  testing  time  on  Two-Hand  Coordination  and  Complex  Coordination,  respectively.  Data  are  based  on  the 
121  subjects  of  Validation  Study  I  who  entered  pilot  training.  All  correlations  are  significant  beyond  the 
.01  level  except  one  for  Complex  Coordination. 


Table  Al.  Correlation  among  X  Axis, 

Y  Axis,  and  Generated  Scores,  Two-Hand 


Coordination 

(1 V*  J  21) 

Gtn  aratvd 

Seor* 

r  X/Y 

X  Axis  Error,  Minute  1 

.95* 

.79* 

X  Axis  Error,  Minute  2 

.98* 

.89* 

X  Axis  Error,  Minute  3 

.96* 

.83* 

\  Axis  Error,  Minute  4 

.97* 

.86* 

X  Axis  Error,  Minute  5 

.97* 

Al* 

Y  Axis  Error,  Minute  1 

.94* 

Y  Axis  Error,  Minute  2 

.97* 

Y  Axis  Error,  Minute  3 

.95* 

Y  Axis  Error,  Minute  4 

.95* 

V  Aids  Error,  Minute  5 

.96* 

Table  A2.  Correlation  among  X  Axis, 
Y  Axis,  and  Generated  Scores, 
Complex  Coordination 
(N=m) 


Ovnwatwf 

Scort 

r  X/Y 

X  Axis  Error,  Minute  1 

.59* 

.11 

X  Axis  Error,  Minute  2 

.82* 

AST 

X  Axis  Error,  Minute  3 

.79* 

59* 

X  Axis  Error,  Minute  4 

.81* 

.43* 

X  Axis  Error,  Minute  5 

.78* 

.42* 

Y  Axis  Error,  Minute  1 

.85* 

Y  Axis  Error,  Minute  2 

.92* 

Y  Axis  Error,  Minute  3 

.91* 

Y  Axis  Error,  Minute  4 

.87* 

Y  Axis  Frror,  Minute  5 

.88* 

♦Significant  beyond  .01  level 


♦Significant  beyond  .01  level. 


Tables  A3,  A4,  and  A5  present  zero  order  validity  data  for  the  AFOQT  and  for  each  minute  of 
performance  on  the  two  psychomotor  tests.  In  Tables  A4  and  A5,  negative  orrelations  with  Giaduation 
indicate  that  graduates  obtain  lower  error  scores  on  the  psychomotor  tests  than  eiiminees.  Positive 
correlations  with  FTD  indicate  that  eiiminees  make  higher  error  scores  than  graduates.  All  these  data  are 
based  on  the  121  cases  from  Validation  Study  I. 


Preceding  page  blank 


Table  A3.  Zero  Order  Validity  of  AFOQT 
Subtests  against  Two  Pilot  Training 
Criteria 
(N  =  121) 


Varlabla 

Graduation 

5TO 

Quantitative  Aptitude 

-.17 

.13 

Verbal  Aptitude 

-.16 

.01 

Biographical  Inventory 

.08 

-.08 

Scale  Reading 

-JO 

-.06 

Aerial  Landmarks 

-.08 

.13 

General  Science 

-.15 

.09 

Mechanical  Information 

-.04 

.09 

Mechanical  Principles 

-.02 

.05 

Pilot  Biographical  Inventory 

.04 

-.03 

Aviation  Information 

-.16 

.10 

Visualization  of  Maneuvers 

-.02 

.00 

Instrument  Comprehension 

.06 

-.18* 

Stick  &  Rudder  Orientation 

.12 

.00 

’Significant  beyond  .05  level. 


Table  A4.  Zero  Order  Validity  of  Two- 
Hand  Coordination  against  Two  Pilot 
Training  Criteria 
(N  =  121) 


Varlabla 

Graduation 

FTD 

X  Axis  Error,  Minute  1 

-.24* 

.17 

X  Axis  Error,  Minute  2 

-.19* 

.11 

X  Axis  Error,  Minute  3 

-.07 

.04 

X  Axis  Error,  Minute  4 

-.14 

.13 

X  Axis  Error,  Minute  5 

-.08 

.50 

Y  Axis  Error,  Minute  1 

-.17 

.12 

Y  Axis  Error,  Minute  2 

-.17 

.09 

Y  Axis  Error,  Minute  3 

-.04 

-.03 

Y  Axis  Error,  Minute  4 

-.07 

.04 

Y  Axis  Error,  Minute  5 

-.04 

.06 

Generated,  Minute  1 

-.22* 

.15 

Generated,  Minute  2 

-.19* 

.10 

Generated,  Minute  3 

-.06 

.01 

Generated,  Minute  4 

-.12 

.10 

Generated,  Minute  5 

-.06 

.06 

’Significant  beyond  .05  level. 


Table  AS.  Zero  Order  Validity 
of  Complex  Coordination  against 
Two  Pilot  Training  Criteria 

(N  =  121) 


Varlabla 


X  Axis  Error,  Minute  1 
X  Axis  Error,  Minute  2 
X  Ards  Error,  Minute  3 
X  Axis  Error,  Minute  4 
X  Axis  Error,  Minute  5 

Y  Axis  Error,  Minute  1 

Y  Axis  Error,  Minute  2 

Y  Axis  Error,  Minute  3 

Y  Axis  Error,  Minute  4 

Y  Axis  Error,  Minute  5 

Resets,  Minute  1 
Resets,  Minute  2 
Resets,  Minute  3 
Resets,  Minute  4 
Resets,  Minute  5 

Generated,  Minute  1 
Generated,  Minute  2 
Generated,  Minute  3 
Generated,  Minute  4 
Generated,  Minute  S 


Graduation  STD 


-.15 

.06 

-.32* 

.14 

-.40* 

.25* 

-.42* 

.29* 

-.41* 

.27* 

-.16 

.09 

-.17 

.06 

-.24* 

.10 

-.20* 

.15 

-.16 

.08 

-.12 

.07 

-.20* 

.09 

-.22* 

.10 

-.16 

.09 

-.09 

.05 

-.21* 

.1! 

-.27* 

.12 

-.34* 

.19* 

-.35* 

.25* 

-.31* 

.20* 

’Significant  beyond  .05  leveL 
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A  different  kind  of  presentation  of  psychomotor  validity  data  is  seen  in  Figures  A1  and  A2.  In  both 
figures,  the  five  observation  points  along  the  base  line  are  minutes  of  the  test  during  which  the  scores  were 
derived.  Figure  A1  (Y-Axis  and  X-Axis)  depicts  mean  performance  on  Two-Hand  Coordination  for  three 
pilot  training  criterion  groups.  In  two-Hand  Coordination,  performance  measured  on  the  X  Axis 
corresponds  to  the  subject’s  right  hand,  and  performance  on  the  Y  Axis  to  the  subject's  left  hand.  Left 
hand  performance  show  little  difference  between  graduates  and  eliminees.  Right  hand  performance, 
however,  shows  higher  mean  error  scores  in  all  observation  periods  for  FTD  eliminees  than  for  graduates. 

Figure  A2  (Y-Axis  and  X-Axis)  shows  mean  performance  on  the  hand  controlled  task  of  Complex 
Coordination,  using  the  same  criterion  groups.  The  mean  error  of  the  FTD  criterion  group  on  both  axes  is 
higher  than  for  graduates.  It  was  not  expected  that  SIE  performance  would  closely  resemble  performance 
by  any  other  criterion  group. 

Tables  A6  through  A8  present  intercorrelatijn  and  zero  order  validity  data  analogous  to  those  in 
Tables  A1  through  AS.  These  data,  however,  are  based  on  the  92  subjects  in  Validation  Study  II.  The 
psychomotor  data  are  derived  only  from  Trials  2  and  3,  and  the  validities  are  only  for  the  Graduation  and 
FTD/SIE  criteria. 

The  original  form  of  the  psychomotor  data  for  the  second  study  was  in  terms  of  intervals  of  five 
seconds.  It  is  of  interest  to  observe  the  course  of  the  mean  error  scores  on  the  three  axes  within  trials  and 
across  trials.  Figure  A3  contrasts  Trials  1  and  5  in  terms  of  error  scores  in  their  original  intervals.  Within 
each  trial,  the  mean  errors  tend  to  decrease.  Across  trials,  the  mean  X  Axis  and  Y  Axis  errors  become 
stabilized  at  about  half  their  original  values  after  IS  minutes  of  testing  time. 
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S1E  (N*9) 


OBSERVATION  OBSERVATION 


"»*  for  Utm  pint  treMag  criterion  froape. 


'ig.  A3.  Mean  error  scores  on  complex  coordination  within  and  between  trkh  1  and  5. 


Table  A  6.  Condition  among  X  Axis,  Y  Axis,  Z  Axis,  and  Generated 
Scores,  Complex  Coordination 
(N  =  92) 


Trial  2  Trl».!  S 

Generate!  Generated 

.Variable  Score  r  X/Y  Score  r  X/Y 


X  Axis  Error,  Minute  1 
X  Axis  Error,  Minute  2 
X  Axis  Error,  Minute  3 
X  Axis  Error,  Minute  4 
X  Axis  Error,  Minute  5 

4 

Y  Axis  Error,  Minute  1 

Y  Axis  Error,  Minute  2 

Y  Axis  Error,  Minute  3 

Y  Axis  Error,  Minute  4 

Y  Axis  Error,  Minute  S 

Z  Axis  Error,  Minute  1 
Z  Axis  Error,  Minute  2 
Z  Axis  Error,  Minute  3 
Z  Axis  Error,  Minute  4 
Z  Axis  Error,  Minute  5 


.80* 

.56* 

.85* 

.56* 

.93* 

.69* 

.96* 

.74* 

.96* 

.81* 

.93* 

.90* 

.91* 

.89* 

.94*' 

.21 

.49* 

.60* 

.66* 

.66* 

.90* 

.62* 

.93* 

.74* 

.92* 

.70* 

.88* 

.62* 

.88* 

.65* 

.89* 

.93* 

.92* 

.91* 

.92* 

35* 

33* 

.50* 

.54* 

.38* 

’Significant  beyond  .01  level. 


Table  A7.  Zero  Order  Validity 
of  AFOQT  Composites  against  Two 
Pilot  Training  Criteria 

(N  =  92l 


Variable 

Graduation 

rrn/ 

sm 

Pilot 

.10 

-.05 

Navigator-Technical 

.01 

.01 

Officer  Quality 

-.06 

01 

Verbal 

-.12 

.08 

Quantitative 

.16 

-.20* 

’Significant  beyond  .05  level. 
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Table  A8.  Zero  Order  Validity  of  Complex 
Coordination  again*  Two  Pilot  Training 
Criteria,  Trial  2 
(N  =  92) 


Variable 


X  Axis  Error,  Minute  1 
X  Axis  Error,  Minute  2 
X  Axis  Error,  Minute  3 
X  Axis  Error,  Minute  4 
X  Axis  Error,  Minute  S 

Y  Axis  Error,  Minute  1 

Y  Axis  Error,  Minute  2 

Y  Axis  Error,  Minute  3 

Y  Axis  Error,  Minute  4 
y  Axis  Error,  Minute  S 

Z  Axis  Error,  Minute  1 
Z  Axis  Eiror,  Minute  2 
Z  Axis  Error,  Minute  3 
Z  Axis  Error,  Minute  4 
Z  Axis  Error,  Minute  5 

Resets,  Minute  1 
Resets,  Minute  2 
Resets,  Minute  3 
Resets,  Minute  4 
Resets,  Minute  5 

Generated,  Minute  i 
Generated,  Minute  2 
Generated,  Minute  3 
Generated,  Minute  4 
Generated,  Minute  5 


Graduation  FTO/SIE 


.04 

-.03 

-.29* 

.28* 

-.22* 

.23* 

-.19 

.17 

-.24 

.23* 

-.15 

.16 

-.29* 

.39* 

-.21* 

.30* 

-.20* 

.26* 

-.27* 

.32* 

-.17 

.13 

.  -.27* 

.26* 

-.29* 

.25* 

-.20* 

.15 

-.27* 

.22* 

.06 

-.08 

-.23* 

.18 

-.20 

.19 

-.21* 

.19 

-.13 

.10 

-.07 

.08 

-.33* 

.37* 

-.24* 

.28* 

-.22* 

.22* 

-.27* 

.29* 

'Significant  beyond  .05  lertL 


